Real-Time Anomaly Detection for Streaming Analytics
نویسندگان
چکیده
Much of the worlds data is streaming, time-series data, where anomalies give significant information in critical situations. Yet detecting anomalies in streaming data is a difficult task, requiring detectors to process data in real-time, and learn while simultaneously making predictions. We present a novel anomaly detection technique based on an on-line sequence memory algorithm called Hierarchical Temporal Memory (HTM). We show results from a live application that detects anomalies in financial metrics in realtime. We also test the algorithm on NAB, a published benchmark for real-time anomaly detection, where our algorithm achieves best-in-class results.
منابع مشابه
On the Runtime-Efficacy Trade-off of Anomaly Detection Techniques for Real-Time Streaming Data
Ever growing volume and velocity of data coupled with decreasing attention span of end users underscore the critical need for real-time analytics. In this regard, anomaly detection plays a key role as an application as well as a means to verify data fidelity. Although the subject of anomaly detection has been researched for over 100 years in a multitude of disciplines such as, but not limited t...
متن کاملAnomaly Detection in Gps Data
Modern machine learning techniques provide robust approaches for datadriven modeling and critical information extraction, while human experts hold the advantage of possessing high-level intelligence and domain-specific expertise. We combine the power of the two for anomaly detection in GPS data by integrating them through a visualization and human-computer interaction interface. In this thesis ...
متن کاملRegression-based Online Anomaly Detection for Smart Grid Data
With the widely used smart meters in the energy sector, anomaly detection becomes a crucial mean to study the unusual consumption behaviors of customers, and to discover unexpected events of using energy promptly. Detecting consumption anomalies is, essentially, a real-time big data analytics problem, which does data mining on a large amount of parallel data streams from smart meters. In this p...
متن کاملPaper SAS645-2017: Real-time Analytics at the Edge: Identifying Abnormal Behavior and Filtering Data near the Edge for Internet of Things Applications
This paper describes the use of a machine learning technique for anomaly detection and the SAS® Event Stream Processing engine to analyze streaming sensor data and determine when performance of a turbofan engine deviates from normal operating conditions. Turbofan engines are the most popular type of propulsion engines used by modern airliners due to their high thrust and good fuel efficiency (N...
متن کاملA Novel Real-time Human Activity Based Anomaly Detection Model Using Graph Based Clustering and Classification Model
Detecting online abnormality in the video surveillance is a challenging issue due to streaming, video noise, outliers and resolution. Traditional trajectory based anomaly detection model which analyzes the video training patterns for anomaly detection. This paper aims to solve the problem of video noise and anomaly detection .In this paper, a novel filtered based ensemble clustering and classif...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1607.02480 شماره
صفحات -
تاریخ انتشار 2016